GENERALIZED ASYNCHRONOUS HDLC SERVICES 



BACKGROUND OF THE INVENTION 

5 

The present invention relates to data networking and more particularly to 
providing framing services on a network employing other protocols such as Internet 
Protocol (IP) and Point-to-Point Protocol (PPP). 

In order to accommodate Internet and other traffic over a wireless network, an 
10 architecture has been designed to transport IP and other data seamlessly. An overall 
architecture for a wireless IP network architecture based on various protocols has been 
described in the Internet Engineering Task Force's Wireless IP Network Architecture 
based on IETF Protocols (Tom Hiller, ed.), IETF TR45.6 Ballot (February 4, 2000), the 
disclosure of which is hereby incorporated by reference. This document describes the 
15 packet data services to be provided, and sets forth the packet data system architecture for 
a third generation wireless system based on IMT-2000. The described system is designed 
to have general capabiUties that match those outlined in the ITU IMT-2000 requirements 
docxmient Q. 1701 . IETF protocols are employed wherever possible to minimize the 
number of new protocols required. 

20 An example of the architecture described is shown in FIG. 1. A user uses mobile 

station 10 to connect to Radio Network 20 via an air interface, and through the Radio 
Network 20, gains access to a service provider network. Only one service provider 
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network may be accessed by the mobile station 10 at a time, and the service provider 
network may be the user's home access provider or if the user is roaming, the visited 
access provider network. Existing air interface procedures are used for access mobility 
5 management, including interactions with Visited Location Registers (VLR) 32 and Home 
Location Registers (HLR) 34. The HLR 34 stores access service profiles that contain 
information about access service parameters, which are cached in the VLR 32 while the 
mobile station 10 is registered in the service provider access network. An open interface, 
known as the R-P interface, is defined between the Radio Network 20 and the Packet 
^™ 1 0 Data Serving Node (PDSN) 30. The PDSN 30 interacts with the local or visited AAA 
-4 (Authentication, Authorization, and Accounting) server 36 and with other servers using 

m IP protocols within the IP Network 38. 

\| FIG. 2 shows a protocol reference model for mobile IP control and Internet Key 

i =^ Exchange (IKE). This model depicts the control and user data protocol relationships 

1 5 among the mobile station 1 0, Radio Network 20, PDSN 30, end host, and, in the case of 
O mobile IP, the Home Agent (HA). As shown, the mobile station uses Airlink, Medium 

Access Control (MAC), Local Access Control (LAC), Point to Point Protocol (PPP), 
bitemet Protocol (IP), User Datagram Protocol (UDP), and Mobile Internet Protocol 
(MEP). The radio network uses Airlink, MAC, and LAC to conmiunicate with the mobile 
20 station. To communicate with the PDSN, the radio network uses Physical Layer (PL) and 
R-P (Radio Network to PDSN). The PDSN uses PL, R-P, PPP (terminating the PPP 
connection from the mobile station), EP, UDP, and MIP. To communicate with the HA, 
the PDSN uses PL, Link Layer, IP/IPsec (secure IP), UDP, and IKE, The HA's protocol 
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stack is similar. The servers contacted by the PDSN 30 or local AAA server may reside 
in other ff domains and be operated by other IMT-2000 operators, ISPs, or Private 
Network operators. Further details of the model, such as service provider boundaries and 
5 logical interfaces among different boundary configurations, may be seen by reference to 
the IETF document. 

In a typical system, the data link layer provides a point to point link between 
mobile station 10 and PDSN 30. Operating the point to point link requires that certain 
services be provided at both ends including framing and deframing, synchronization, 

10 error correction, etc. In particular, providing framing services is a key ftmction in 

operating the point to point link between mobile station 10 and PDSN 30. Data packets 
from higher layer protocols are framed before being transmitted over the point to point 
link, and deframed at the receiving side before being forwarded for further processing. 
While mobile station 10 may only operate one or a small number of point to point links 

15 simultaneously, even a single interface of PDSN 30 may terminate point to point hnks to 
numerous mobile stations. If PDSN 30 is implemented by a typical router architecture, 
each interface will have its own single framing engine to provide framing and deframing 
services to multiple point to point connections. Multiple data streams are sent by each 
interface to its own single framing engine for framing and/or deframing services. Often a 

20 framing engine associated with one interface will have unused cycles while a number of 
data streams are backed up on another interface awaiting framing or deframing. There is 
a need, therefore, for an improved architecture for providing improved 
framing/deframing services. 
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Summary Of The invention 

A router in a network comprises an interface system for receiving packets and has 
a plurality of channels and a plurality of framing service engines. The router is 
5 configured to assign the channels to individual framing service engines for framing 
services. The router has a channel manager for performing the assignments, and the 
channel manager is configured to receive and use data about the framing service engines. 
The router fiirther comprises a framing memory for buffering communication between 
the interface system and the plxurality of framing service engines. At least one framing 
\i 10 service engine is configured to frame packets and at least one framing service engine is 
ill configured to deframe packets, and the framing service engines may be configured to 

i'P operate on AHDLC packets. The router can be used with an interface system that 

comprises a plurality of network interfaces terminating a plurality of point to point links. 

A fiirther understanding of the nature and advantages of the inventions herein may 
:^ 15 be realized by reference to the remaining portions of the specification and the attached 
drawings. 
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Brief Description Of The Drawtncs 



FIG. 1 is a simplified model of the packet data system architecture for a third 
generation wireless system based on IMT-2000; 

FIG. 2 depicts a protocol reference model usable with the system of FIG. 1 and 
providing mobile IP control and Internet Key Exchange; 

FIG. 3 is a simpUfied diagram of router hardware suitable for implementing one 
embodiment of the present invention; 

FIG. 4 is a simplified model of the packet data system architecture for a third 
generation wireless system of the present invention; 

FIG. 5 depicts protocol stacks used in the system of FIG. 4 for the mobile station 
and BSC to PSDN; and 

FIG, 6 is a simplified model of the packet data system architecture for a third 
generation wireless system embodying the invention. 



Attorney Docket No. CISCP657 



5 



Patent 



DESCRIPTION OF SPECIFIC EMBODIMENTS 

Generally, the packet processing and management techniques of the present 
5 invention may be implemented in software and/or hardware. For example, they can be 
implemented in an operating system kernel, in separate user processes, in a library 
package boxmd into a network appUcation, on a specially constructed machine, or on a 
network interface card. In specific embodiment of this invention, these techniques may 
be implemented in software such as an operating system or in an application ruiming on 
10 an operating system. 

A software or software/hardware hybrid packet processing and management 
system of this invention is preferably implemented on a general-purpose programmable 
machine selectively activated or reconfigured by a computer program stored in memory. 
Such a programmable machine may be a network device designed to handle network 

1 5 traffic. Such network devices typically have multiple network interfaces including firame 
relay and ISDN interfaces, for example. Specific examples of such network devices 
include routers and switches. For example, the packet processing and management 
systems of this invention may operate on specially configured routers such as those 
available fi-om Cisco Systems, Inc. of San Jose, California. A general architecture for 

20 some of these machines will appear firom the description given below. In an altemative 
embodiment, the packet processing system may be implemented on a general-purpose 
network host machine such as a personal computer or workstation adapted to interface 
with computer networks. 
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Referring now to FIG. 3, a router 40 suitable for implementing the present 
invention includes a master central processing unit (CPU) 42, interfaces 48, and a bus 52 
(e.g., a PCI bus). As shown, CPU 42 includes a memory 44 and a processor 46. When 
5 acting under the control of appropriate software or firmware, CPU 42 is responsible for 
such router tasks as routing table computations, network management, and general 
processing of packets. It preferably accomplishes all these functions under the control of 
software including an operating system (e.g., a version of the Internetwork Operating 
Systems (lOS®) of Cisco Systems, Inc.) and any appropriate applications software. CPU 
10 42 may include one or more processors 46 such as a processor from the Motorola family 
: J or MIPS family of microprocessors. In an alternative embodiment, processor 46 is 

specially designed hardware for controUing the operations of router 40. Memory 44 can 
rp be non-volatile RAM and/or ROM. However, there are many different ways in which 

memory could be coupled to the system. 

^ 1 5 The interfaces 48 are typically provided as interface cards (sometimes referred to 

Q as "line cards"). Generally, they control the sending and receiving of data packets over 

the network and sometimes support other peripherals used with the router 40, Among the 
interfaces that may be provided are Ethernet interfaces, frame relay interfaces, cable 
interfaces, DSL interfaces, token ring interfaces, and the like. In addition, various high- 
20 speed interfaces may be provided such as fast Ethernet interfaces, Gigabit Ethernet 
interfaces, ATM interfaces, HSSI interfaces, POS interfaces, FDDI interfaces, and the 
like. Generally, these interfaces may include ports appropriate for conmiunication with 
the appropriate media. In some cases, they may also include an independent processor 
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and, in some instances, volatile RAM. The independent processor may control such 
communications intensive tasks as packet switching, media control, and management. 
By providing separate processors for the communications intensive tasks, these interfaces 
5 allow the master microprocessor 42 to efficiently perform routing computations, network 
diagnostics, security functions, etc. Another function performed by the interfaces may be 
terminating point to point links, e.g., according to the point to point protocol and 
providing fi^aming services. Router 40 may further include a packet memory 50 for 
intermediate storage of packets being forwarded by router 40. 

10 Although the system shown in FIG. 3 is one specific router of the present 

invention, it is by no means the only architecture on which the present invention can be 
implemented. For example, an architecture having a single processor that handles 
communications as well as routing computations, etc. is often used. Further, other types 
of interfaces and media could also be used with the router. 

1 5 Regardless of a network device's configuration, it may employ one or more 

memories or memory modules (including memory 44) configured to store program 
instructions for the general-purpose network operations and packet processing and 
management functions described herein. The program instructions may control the 
operation of an operating system and/or one or more applications, for example. 

20 Because such information and program instructions may be employed to 

implement the systems/methods described herein, the present invention relates to 
machine readable media that include program instructions, state information, etc. for 
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performing various operations described herein. Examples of machine-readable media 
include, but are not limited to, magnetic media such as hard disks, floppy disks, and 
magnetic tape; optical media such as CD-ROM disks; magneto-optical media such as 
5 optical disks; and hardware devices that are specially configured to store and perform 
program instructions, such as read-only memory devices (ROM) and random access 
memory (RAM). The invention may also be embodied in a carrier wave travelling over 
an appropriate medium such as airwaves, optical lines, electric lines, etc. Examples of 
program instructions include both machine code, such as produced by a compiler, and 
10 files containing higher level code that may be executed by the computer using an 
interpreter. 

In a CDMA-based cellular packet network, a PPP session can be set up from a 
mobile station all the way through to the PDSN. The router of FIG. 3 may implement 
PDSN 30 of FIG. 1 and therefore terminate point to point links from numerous mobile 

15 stations. A key functionality for supporting these point to point links is to provide 

firaming services, because link-layer firaming facilitates complicated processing of data 
streams at the receiving end, such as flow control, data compression, signaling, and 
reliable transmission. At the sending side, data packets from higher layer protocols are 
fi-amed before being transmitted over the interfaces 48. At the receiving side, data 

20 streams from lower layer protocols or the interfaces 48 are deframed before being 
forwarded to output interfaces 48 or handed over to higher layer protocols for further 
processing. 
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These point to point links are operated in accordance with Point to Point Protocol, 
which is described in RFC 1661 (W. Simpson, Editor), titled "The Point-to-Point 
Protocol (PPP)", the disclosure of which is hereby incorporated by reference. PPP 
5 employs High-Level Data Link Control (HDLC) for framing and deframing servicesover 
a variety of physical transmission media, such as EIA RS-232, Tl/El, and OC-3. The use 
of HDLC in PPP is described in the Internet Engineering Task Force's RFC 1662 (W. 
Simpson, ed.), titled "PPP in HDLC-Like Framing" and RFC 2687 (C, Bormann), titled 
"PPP in a Real-time Oriented HDLC-like Framing", the disclosures of which are hereby 
1 0 incorporated by reference. 

There are several variants of HDLC, including asynchronous HDLC (AHDLC), 
bit-synchronous HDLC, and octet-synchronous HDLC. The type of framing used 
depends on the particular hardware interface or protocol requirements. For example, bit- 
synchronous HDLC is used on most telecommunications interfaces for PPP, such as Tl 
15 and most ISDN hnks. AHDLC is used for PPP over asynchronous links and is widely 
used because laptop computers, 3G cell phones, etc. are typically not equipped with the 
necessary synchronous hardware. 

The sending and receiving ends of a PPP connection may employ two different 
HDLC framing services. A PC that does not have the necessary synchronous hardware 
20 may be connected through an ISDN interface to a system that runs bit- or octet- 
synchronous PPP, requiring a HDLC framing service system that translates HDLC 
frames from one type to another. The invention will be described in terms of its 
appHcation to AHDLC, but one skilled in the art will recognize that the concepts and 
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methods of the present invention have applicability in other respects, and the disclosure 
hereof is intended to cover all such applications. 

FIG. 4 illustrates how a mobile station 60 can be provided with access to an ff 
network via a packet data serving node (PDSN 66) according to one embodiment of the 
present invention. FIG. 5 illustrates protocol stacks operative at mobile station 60 and 
PDSN 66. 

At mobile station 60, higher level applications generate and receive IP packets. 
These IP packets are communicated through a point to point connection operated in 
accordance with PPP. Framing services for PPP are provided by the AHDLC protocol. 
Physical layer communication of the PPP frames to and from a base tower station (BTS) 
62 is via an air interface serial connection. BTS 62 embodies a Packet Control Function 
which is in communication with PDSN 66. The link to PDSN 66 is actually itself via an 
IP network rather than a point to point connection. To transmit the PPP frames through 
this IP network, they are encapsulated within IP packets in accordance with Generic 
Routing Encapsulation (GRE) as described in RFC 1701 (S. Hanks, T. Li, D. Farinacci, 
P. Traina), titled "Generic Routing Encapsulation (GRE)", the disclosure of which is 
hereby incorporated by reference. 

Thus, the PDSN operates the following protocol stack to interface to mobile 
station 60 though BTS 62 and BSC/PCF 64. A MAC layer protocol operates 
appropriately for whatever medium PDSN 66 is directly connected to. Above this, an IP 
layer handles the communication of IP packets between PDSN 66 and BSC/PCF 64. 
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These IP packets encapsulate PPP data framed in accordance with HDLC. A GRE layer 
handles the encapsulation and deencapsulation processes. AHDLC and PPP layers 
terminate the PPP connection from mobile station 60. The higher of the two IP layers 
5 then can route IP packets originating with mobile station 60 to points accessible via an TP 
network 68 as well as IP packets traveUing the other direction. Note that there are two 
different EP layers operating at PDSN 66. A higher IP layer processes packets to/from 
mobile station 60. A lower IP layer processes packets travelling between PDSN 66 and 
BSC/PCF 64. Again, these lower layer IP packets encapsulate PPP data framed 
1 0 according to AHDLC. 

i ,1 Because PPP is terminated at the PDSN 66, the PDSN 66 must perform a great 

: Q deal of AHDLC framing and deframing. One approach for providing the AHDLC 

\| framing service is to use a dedicated hardware ASIC chip on each interface 48 in the 

U router of FIG. 3. Data streams from a media interface (e.g., an ATM interface) are 

i ^ 15 directed to this special ASIC chip, and the output frame from this chip is sent for further 
■ f processing imder PPP protocol. However, this approach requures a dedicated ASIC chip 

for each interface 48 that provides AHDLC framing services. Multiple interfaces 48 
cannot share an ASIC chip even if some interfaces 48 are idle. Further, in the case of 
interfaces that support multiple channels or sub-interfaces (such as an ATM or cable 
20 interface), the AHDLC framing service must be able to handle the maximal number of 
channels or sub-interfaces simultaneously. This is done in a time division multiplexing 
(TDM) scheme, in which all channels or sub-interfaces (e.g., PPP connections, virtual 
circuits, etc.) are serviced in round robin fashion. If a channel or sub-interface does not 
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use its allotted AHDLC processing capacity, that unused capacity cannot be used by 
others. This results in longer AHDLC processing latency for TDM than if capacity could 
be shared and statistical multiplexing were supported. As disclosed herein, the present 
5 invention incorporates the ability to use statistical multiplexing to significantly reduce 
AHDLC processing latency and increase utilization of the AHDLC processing capacity. 

In accordance with the invention, generic AHDLC framing services are provided 
in an arrangement that permits sharing of AHDLC processing capacity among multiple 
interfaces, and makes more efficient use of system resources. A limited number of 

10 AHDLC framing engines can be used to serve the whole router system instead of 
requiring per-channel AHDLC service engines for the maximal number of channels 
supported. Using dynamic channel allocation, data streams from one interface may 
receive preferential treatment over others if desired, to improve end-to-end quality of 
service for that interface. Although the invention is being described in terms of its 

1 5 application to AHDLC framing services, one skilled in the art will readily recognize that 
the concepts of the invention may be applied with equal facility to framing, translation, 
and other processing under other protocols. 

FIG. 6 shows the router system of FIG. 3 with an improved AHDLC framing 
service in accordance with the invention. An AHDLC service system may be included as 
20 a separate card within the router system. In one embodiment of the invention, the 

AHDLC service system comprises a channel manager 80 and one or more channehzed 
framing and deframing service engines 82 and 84. A framing engine that performs both 
framing and deframing may be used as well. The framing and deframing engines 82 and 
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84 may be implemented in software or in hardware such as ASIC chips, and perform 
framing/deframing, reassembUng, and FCS checksum functions. These engines are 
shared by interfaces, sub-interfaces, and channels in the router system. The channel 
5 manager 80 performs the task of dynamically allocating a framing engine 82 or 

deframing engine 84 to an interface, sub-interface, or channel. The channel manager 80 
may be implemented in hardware or in software. A framing memory 86 is shown where 
interfaces may store data to be frames or retrieve frames generated by one of the framing 
services engines. It should be understood that although FIG. 6 depicts the channel 
10 manager 80, framing engine 82, and deframing engines 84 separately, they could be 
structured so that some or all of them are present on the interfaces 48. 

The framing and deframing engines 82 and 84 are employed for outgoing and 
incoming traffic. Each service engine is channelized in the sense that multiple data 
streams can be handled simultaneously, independent of the arrival time of traffic streams 
15 from different interfaces, sub-interfaces, or channels. In order to accompHsh this, the 
service engine maintains the intermediate state for each chaimel. There is a logical 
AHDLC service agent for each channel, up to the maximum number of channels 
supported. 

All logical AHDLC service agents share one or more processing units that 
20 perform AHDLC framing or deframing services (service engines). A service engine that 
serves fewer channels at a given moment may have more processing cycles and therefore, 
shorter latency, than another engine that serves more channels. Different pohcies for 
allocating capacity to different channels create flexibility to provide different levels of 
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service. For example, the processing capacity in a service engine can be allocated 
statically, such as in a First-Come-First-Served (FCFS) or round robin fashion. It can be 
allocated dynamically by giving higher priority to channels that have higher priority 
assigned to them. A channel waiting for its data stream to be served may buffer its data 
in main memory, to be sent to the service engine through DMA (direct memory access). 
Assignment of a logical service agent to a channel is dynamically performed by the 
channel manager 80. 

As described herein, the logical service agents are dynamically allocated and 
deallocated to an interface or sub-interface, such as an ATM VC (virtual circuit) a frame 
relay VC, or a cable channel. The channel manager 80 maintains a global table that 
records the current allocation and load information for each service engine 82 and 84. 

When an interface or sub-interface is configured or a channel is established, a 
request is made to the channel manager 80 for allocation of a logical AHDLC service 
agent. The channel manager 80 can be configured to fiuther distinguish whether the 
requesting channel is a simplex or duplex connection, and perform allocations 
accordmgly (such as to a logical firaming agent and/or a logical defiraming agent). 

Upon receiving the request for allocation of a logical service agent, the channel 
manager selects an AHDLC service engme 82 or 84. The selection decision may be 
static, based on the number of channels that have been allocated to each of the service 
engines 82 and 84 (e.g. selecting the service engine with the fewest channels allocated to 
it). However, this would not necessarily reflect the actual load on the engine, because 
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many channels can sit idle. Traffic statistics for each service engine 82 or 84 can be 
collected and periodically sent to the channel manager 80. Based on this load 
information indicating the utilization of the service engine, the selection of a service 
engine 82 or 84 can be based on the dynamic traffic load of each service engine, so that 
the channel manager 80 can select the service engine v^ith the lowest load. 

Once a framing or deframing service engine 82 or 84 has been selected by the 
channel manager 80, the channel manager 80 allocates an idle agent associated with a 
channel in that service engine 82 or 84. This results in the association of the data path of 
the interface, sub-interface, or channel with the allocated logical framing/deframing 
agent. If the service engine 82 or 84 uses multiple job queues, the channel may be 
associated with a job queue with the appropriate priority. For example, a time critical 
data stream may be assigned to a logical agent for a channel associated with a high 
priority job queue in the selected service engine 82 or 84. 

After the logical agent associated with an AHDLC service engine 82 or 84 has 
been allocated, the data stream from the assigned interface, sub-interface, or channel is 
forwarded to the allocated AHDLC service engine 82 or 84. Data streams received from 
a device may be buffered in the router processor 42, in a virtual interface processor (VIP) 
implemented within a shared processor, in main memory, or in framing memory 86 
before being sent to the AHDLC service engine 82 or 84. Similarly, data streams (such 
as AHDLC frames) coming from the AHDLC service engine 82 or 84 may be buffered 
before being transmitted or processed fixrther. The framing or deframing agent and its 
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associated channel in the service engine 82 or 84 are deallocated when the interface or 
sub-interface is shut down or the channel is closed. 

One skilled in the art will recognize that there are many advantages to the 
invention. Because there is no dedication of an AHDLC service engine to an interface, 
sub-interface, or channel, AHDLC jfraniing and deframing capacity can be shared in an 
efficient manner, thus reducing the cost for hardware to perform AHDLC framing in a 
router system. Because the AHDLC service engine does not have to be shared in a TDM 
scheme, processing capacity is not wasted on idle channels and is used more efficiently. 
Further, the configuration of the AHDLC as a standalone service facilitates "plug-and- 
play" addition of more framing and deframing service engmes, because it is independent 
of interface type and transmission media type. The framing and deframing engines can 
be dynamically configured, such as changing the asynchronous control character map 
(ACCM) and frame check sequence (FCS) sizes for different interfaces or channels. The 
configuration can be changed after an engine is allocated. Additionally, the framing and 
deframing engines are dynamically allocated when requested by interfaces, sub- 
interfaces, and channels, and different allocation pohcies can be implemented. For 
example, an interface or channel with higher priority may be given priority in allocation 
of AHDLC framing services. A time critical channel that is sensitive to delays may 
receive service from an AHDLC engine that is currently serving fewer channels. The 
channel manager may also reallocate service engines in order to balance loads among the 
service engines. Additionally, the framing and deframing services are decoupled from 
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each other, and an interface or channel may request only framing or only deframing 
services according to its needs. 

It is understood that the examples and embodiments are described herein are for 
5 illustrative purposes only and that various modifications and changes in light thereof will 
be suggested to persons skilled in the art and are to be included within the spirit and 
perview of this application and scope of the appended claims and their full scope of 
equivalents. For example, the separation of the framing services from the interfaces is 
not hmited to AHDLC protocol and may be applied to other protocols requiring framing, 
10 and it is intended that the disclosure apply to such other protocols as if fiilly set forth 
herein. All publications, patents, and patent appUcations cited herein are hereby 
incorporated by reference. 

What is claimed is: 
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